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Abstract: An important part of stereo vision consists of finding and matching points in 
two images which correspond to the same physical element in the scene. We show that 
zeros of curvature of curves are perspective projection invariants and can therefore be 
used to find corresponding points. They can be used to help solve the registration problem 
(Longuet-Higgins, 1982) and to obtain the correct depth when a curve enters the forbidden 
zone (Krol and van de Grind, 1982). They are also relevant to theories for representing 
image curves. We consider the stability of these zeros of curvature. 
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Perspective Projection Invariants 



The goal of stereopsis in computer vision is the recovery of the 3D structure of a scene, 
given two different images of it. This recovery is preceeded by the search for corresponding 
features of the two images, that is to say features that correspond to the same physical 
elements in the scene (1,17). 

If the two images are taken from two close points of view, they will typically be just 
slightly different: then standard correlation techniques can identify corresponding elements 
(2,3,4,5,6,7,8). Once this correspondence has been obtained, triangulation methods allow 
the 3D reconstruction of the scene. It can be shown that in this case the error made in the 
reconstruction is large, while if the two images are taken from two very different points of 
view the error is smaller (9). However when the two images are taken from points of view far 
apart from each other they will look very different and standard correlation techniques will 
fail in the search for corresponding elements. This search, therefore, must be guided by new 
rules, taking into account features having invariant properties under arbitrary perspective 
projections. Such invariant features will project to corresponding points in the two images. 

Epipolar lines in the two images are lines on which corresponding points lie. The projections 
of a point P in space lie on the plane defined by P and the two camera foci and hence 
on the two lines defined by the intersection of this plane with the two image planes (see 
figure 1). 

If the epipolar lines are known the matching problem is reduced to a one-dimensional 
search. Moreover the ordering of edges, or other features, is usually preserved along 
epipolar lines. Many stereo algorithms make use of the ordering constraint along epipolar 
lines. This ordering constraint is violated for an object in the "forbidden zone" (14, 15, 16). 
If a point B lies in the forbidden zone of a point A and the two points are connected by an 
opaque surface then the two images would see opposite sides of the surface (see figure 
2). 

To determine the epipolar lines we must find the camera geometry by registering the 
image. Longuet-Higgins (1982) has described a method for solving the registration problem 
assuming that three corresponding points in the two images are known. Perspective 
invariants project to corresponding points in the two images and hence could be used to 
solve this problem. They could also be used as consistency checks to see if the ordering 
constraint is violated. When the object enters the forbidden zone the ordering constraint will 
give false matches. These false matches could be detected if we could find corresponding 
points. 
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Figure 1. See text. 

In this note we prove that points of zero curvature of planar curves are "perspective 
invariants" and that points of zero curvature of non planar curves are almost always 
"perspective invariants" with the exception of non generic cases(10). Moreover we briefly 
analyze the stability in 2D and 3D of such points, considered as zeros of curvature. We 
show that the zeros of curvature of planar curves are structurally stable for a 2D deformation 
(one lying on the plane of the curve) but not for a 3D one. Since projections map 3D curves 
into 2D ones, however, projections of almost planar curves show some stability properties. 
On the contrary, zeros of curvature of arbitrary 3D curves do not present any simple kind 
of stability. 

Thus zeros of curvature of planar or almost planar curves are features that can be 
successfully used in solving the "correspondence problem" in stereopsis when the scene 
is observed from two very different points of view. Since zeros of curvature in two images 
correspond they can be used to solve the registration problem for stereo (13). The projection 
invariants of zeros of curvature and the constraint that matches take place between points 
on corresponding epipolar lines have been used to construct an algorithm able to solve 
the correspondence problem for arbitrary 2D curves even when the ordering constraint is 
violated (11). 

Recent work on representing image curves involves filtering the curve with gaussians of 
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Figure 2. See text. 

different sizes to obtain a multiscale description which can be interpreted in terms of a 
small set of primitives thereby producing a curvature primal sketch (18). Marimont (19) 
considers planar curves projected orthographically onto the viewing plane. He suggests 
using zeros and extrema of curvature as primitives because of their invariance, and 
approximate invariance, under change of viewpoint. Zeros of curvature of the curve are 
moreover preserved when the curve is convolved with a gaussian filter. The results in this 
paper extend this work by showing that zeros of curvature are invariants even when the 
curve is non-planar and the projection is perspective. 

Section 1. 

Let 7 be a curve in the 3D space and i P its perspective projection with respect to a focus 
on a plane <t>. Let / be the focal length, the distance between and *. 

If we introduce a system of coordinates (x, y, z) centered on then 7 will be described by 
the vector valued function x(«) = (x(a), y{»), z(.*)) where .1, the arc length of 7, varies in a 
given interval [a, b] of R and t P by x p = x p (s). It is easy to see that the following relationship 
holds between x p and x (see fig. 3) 



M-' 
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Figure 3. See text. 

where a is the unit normal vector to the projection plane $: notice that x ■ a ^ for all a 
since we suppose that the perspective projection exists. 

From now on T(T P ) will indicate the unit tangent vector to the curve (projected curve), 
N(N P ) the unit normal to the curve (projected curve) and B(B P ) the unit binormal to the 
curve (projected curve). Suppose moreover that each component of x(a) is a function twice 
differentiable with respect to a. 

From elementary differential geometry we have: 



"WHI^II (i-2) 

where «(«) is the curvature of 7 at the point x(a) and: 



,<<%(*), 






where k,,(s p ) is the curvature of ~t P at the point x p (.i v ) , with ,i p being the arc length of 7,,. 
Now let us compute k,,. It is easy to see that: 
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-*■ = r^L (1-4) 

da (x ■ a)' 

where 

I = flX(IX4 (1.5) 

Since s p is the arc length of x p 

_dx p dx p _ dx p dx p f da \ 2 

Zp ' Zp ~ dV p ' d~a~ p ~ ~da~ ' 1a\dV p ) * ' ' 

and hence 

da (s.-a) 2 1 



da p f |Z| 

Notice that (1 .7) holds if 



dT p ^ dT p da 
<p 

Substituting (1.9), (1.7) and (1.3) in (1.10) gives 



but 



(1.7) 



U\ ¥= (1.8a) 

and that (1 .8a) always holds (see (1 .3)) unless 1 

T || * (1.86) 

Now 

Z P = ifi a (1.9) 

and 



"A = ^ = -sf^- ( L1 °) 



^=nm% "•"' 



'If this condition is not satisfied then a cusp will typically be generated in 7 P . 
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da 



(ra)-ra*"(2 x 4- (112) 



and so 



Notice that 



^=w zx (S x 4 c' 3 ) 



■j= = «a X {N X a) = kL (1.14) 



where we set 



£ = « x (iV x x). (1.15) 



So (1.13) becomes 



(a -a) 2 



« P iV p = ^jTjf «A£ (1.16) 



where we set 



I=Jx(iXl). (1.17) 

Notice that |M| = if and only if ]_ = 0L for some real number /?. This can easily be seen 
from (1.17): looking at (1.5) and (1.14) it is obvious that such a (3 exists if and only if x,N_,Z 
are coplanar, that is if and only if x ■ N x T — (we ignore the possibility that a • x — 
since in this case the eye cannot see the point). 

Now we can prove the following theorems. 

Theorem 1. 

Let 7 be a simple planar curve and 7 P its perspective projection onto a plane * with respect 
to a focus O. Let us use the same notation and hypotheses as above. Then: for every s 
for which k is defined k p is also defined. Moreover, whenever there exists an s such that 
K.(ti ) =-- then K]>(s ) — and vice versa. 

Proof 

Notice that for a planar curve for which a perspective projection with respect to a focus O 
exists, x • JV x T -/- for all .<*, since the plane containing the curve does not pass through 
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Figure 4. See text. 

the point O. Hence (1.8a) and (1.8b) always hold, thus (1.16) holds as well and the first 
statement of the theorem is proved. 

Moreover from (1.16) it follows immediately that when there exists an s such that k(s ) = 
then k p (s ) = 0. The converse is also true since in the right hand side of (1.16) (x-a) 2 > for 
all s by hypotheses and \M_\ ^ because as mentioned above x,K,Z cannot be coplanar. 
So if K p (a ) = (1.17) holds if /c(a ) = 0. 

Theorem 2 

Let us suppose that 7 is a generic non planar curve and t p its perspective projection with 
respect to a focus O on a plane *. Then with the same notation and hypotheses as above: 
for every a for which k is defined and unless T || x then k p is defined. Moreover whenever 
there exists s such that /c(« ) = then k p (s p ) = (see fig.4). 

Proof 



Notice that for any curve (1.8a) holds if (1.8b) holds, that is it holds unless T 
from the hypotheses of the theorem the proof follows directly from (1.16). 

Theorem 3 



x. Then 
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Figure 5. See text. 

With the same hypotheses as theorem 2 a necessary and sufficient condition for there to 
exist an a such k p (s q ) = while *( a o) *£ is that x( a o) -KM X T(s ) = 0. 

Proof 

The theorem is an direct consequence of the fact that, by the hypotheses of theorem 2, 
(1.16) holds and that |M(«o)| = if and only if x(s ), KM and r(s ) are coplanar. 

Theorem 1 says that for any planar curve points of zero curvature are preserved under 
arbitrary perspective projection: theorem 2 says that for arbitrary curves points of zero 
curvature are transformed into points of zero curvature of the projected curve. The converse, 
as shown in theorem 3, is true except for the case in which x, K and T are coplanar (see 
fig.5). 

. This case, however, is non generic since a small displacement of the focus of projection 
will destroy the coplanarity. 

It is worth noticing that even cusps have the same property of invariance, but as 
discontinuities of the curvature they are not easily identified in computer implementation 
(while zeros of curvature are). 

Section 2. 

In this section we discuss the stability of 2D and 3D zeros of curvature. Before starting the 
discussion let us summarize some elementary results of differential geometry (12). 
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Let 7 be a smooth curve lying on a smooth surface. The component of the curvature vector 
d 2 x/d$ 2 along the direction of the surface normal is called the normal curvature. Therefore 
if n is the unit vector normal to the surface and K n the normal curvature, then for every a 
we have: 

d x 
K n = —-z • n = /c/v • n. (2.1) 

da* 

Moreover the component of the curvature vector along the unit vector u, orthogonal to the 
surface normal and such that u ■ (n x K) — is called the geodesic curvature. It is easy 
to see that the geodesic curvature at a point is equal to the ordinary curvature times the 
cosine of the angle between the osculating plane to the curve (the plane through the 
point containing the tangent and normal vectors to the curve) and the tangent plane to the 
surface. Therefore, if «„ is the geodesic curvature, for every a we have: 

K g == kcosO (2.2) 

and clearly: 



«' = ««+«». (2.3) 

It is clear that K n must have a maximum ki and a minimum k 2 , called the first and second 
principal curvatures respectively, since it is a continuous function on a closed bounded 
set. Moreover the directions of the two principal curvatures are mutually orthogonal and if 
<j> is the angle between the tangent to the curve and the first principal curvature we have: 



K n = Kicoa <f> + K^ain (j>. (2.4) 

This relationship will be useful later on, since it suggests examples of surfaces on which 
no curve can show zeros of K n and therefore no zeros of curvature at all. 

Consider now the set r of curves in the x, y plane with only one zero of curvature. It can 
be defined as follows: -ycP if its parametric equations x == x(s), y = y(a) are continuous with 
derivatives continuous up to every order: moreover 

x' 2 (») + y'%) = 1 (2.5) 

for every s and 
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x" 2 + / 2 ^ (2.6) 

for every a ^ s , where s is the point of zero curvature. 

At the point (x(s ), y(s )) 7 has a zero of curvature and in consequence the normal and the 
binormal to that curve at that point are not well defined. For a planar curve the normal 
vector to a curve can be defined to be the unit vector lying in the plane perpendicular to 
the tangent. Since the functions x and y have continuous second derivatives the left and 
right limits of the unit normal as s goes to s must exist, for when a = a : 

n=( m -*"M— ) l27) 

\y/x»*{s) + y»*(a)' ^x" 2 {s) + y" 2 (a)J K ' J 

Moreover these two limits, not necessarily coincident, allow the existence of the following 
vector product limits: 

Hm a ^ ao+ T(a) X N(a) = B(a ) + 

Hm a ^ ao _T(s) X N(s) = B( 8o )- (2.8) 



since 



B{a) = l{a) X N{s). (2.9) 



But 



£(3) • jV(s) = (2.10) 



for every «^s and so 



£(so) + - «M- = ±1 (2.10) 



or equivalents 



N.M+ ■ KM- = ±1 (2.11) 

where 7V(.s ) + and K{«o)~ are respectively the right and left limits of the unit normal for 

.1 H> ,1 . 



10 
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Expression (2.10) is more useful than (2.11), since for a planar curve the direction of the; 
binormal is constant. So at such points the limit of the binormal can change sign and 
therefore we can arbitrarily set the value of the sign of the curvature at a given point where 
k^O and then detect and define a change of sign whenever the binormal, or rather its 
limit expression, changes its sign. o 

We now make use of Morse theory (10). Intuitively if the zero of a function f(x) is a zero 
crossing (in other words if the function changes sign at the zero) then a small perturbation 
of the function will not alter the existence of such a zero, although it may move its position. : 
The zero is then said to be stable. Moreover most zeros of functions are zero crossings. This 
can be contrasted with the behaviour of a function like g(x) = x l which has a zero, but not a 
zero crossing, at x = 0. A small perturbation of g{x), such as adding an infinitesimal number 
e will destroy this zero. Thus the typical zeros of a typical function will be zero-crossings 
and stable under .perturbations of the function. In Morse theory these intuitions are made 
precise: typical functions are Morse functions and have transversal zero-crossings which 
have structually stable intersections with the zero axis. For our purposes this result means 
that zeros of curvature are stable if they are zero-crossings. 

Note that if we had adopted the definition of curvature as a positive function there would 
have been a problem of defining transversality of the function itself with respect to zero. 

We now consider three dimensional perturbations of non-planar curves. We will consider 
curves which lie on a cylinder with a fixed cylindrical projection onto the x,y plane (see 
fig.6). 

Varying the radius of the cylinder gives us a one-parameter family of non-planar curves. 
Small changes of the radius give rise to small non-planar perturbations of the curve. 

Let 7 be a planar curve whose parametric equations are x = x(t), y = y[t), where t is the 
arc length. If we think of every point in the x, y plane as being the projection of a point 
lying on a cylinder of radius R whose principal axis has equation: 

X = 0, y^y, Z = R (2.12) 

then the equations of the curve 7 C whose cylindrical projection on the x, y plane gives -y 
are (see fig .4): 

it ■ *w 



(2-13) 



11 
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Figure 6. See text. 



r, „ X(t) 

z e — R-Rcoa-^-. 
R 



Notice that when R ►-+ +00 the first order approximation of 7 C gives: 



x e = x(t) 



Vc = 2/(0 



(2.14) 



Zc=0. 



Therefore when R is large, t c can be seen as a slight 3D perturbation of 7. Let us now 
compute k c , the curvature of i c . Differentiating (2.13) gives: 



*c = COS---x{t) 



12 
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y' c = y\t) (2-15) 



Notice that t is the arc length for ^ c too .since x' c 2 + y' 2 + z' 2 = 1. Differentiating (2.15) we 
obtain: 



v? = »"W (2-16) 



x(i)x' 2 (i) , ., *(t) *, 



+ sin~~-x"(t) 



therefore 



It R R 



.2 x (') , „//2/.\ , „.//2 



tf 2 

It is easy to show that (in the obvious notation) 



+ x" 2 (i) + y" 2 {t). (2.17) 



x 



/2 



(*) 



«c» = ^ (2-18) 



and 



x" 2 (t) + 2/" 2 (t) = <„. (2.19) 

Therefore when k = 0, /c c = if and only if x' = 0, i.e. if the tangent to the curve at the 
zero of curvature is parallel to the cylindric axis. This condition is usually not satisfied, so 
2D zeros of curvature disappear for 3D perturbation. 

Despite the instability of the 2D zeros of curvature for 3D perturbations, since projection is 
a mapping from R* to It 2 , we can recover in a rough sense some kind of stability for 2D 
zeros of curvature. In fact every projection of a small 3D perturbation of a planar curve, 
which had a zero of curvature, shows a zero-crossing of curvature in the neighbourhood 
of the corresponding projected point. The size of the neighbourhood will depend on the 
deviation of the surface containing the curve from a plane. 



13 



YUILLE, VERRI 

For a generic 3D curve the situation is more complicated since it is not possible to extend 
the definition of sign of curvature given above. As an example consider a closed smooth 
curve lying on a cylinder such that there is only one point with a zero of curvature (a curve 
similar to a distorted sine wave pattern turned in on itself). Explicit computations in this 
case show that the left and right limits of the binormal at that point have the same direction 
but opposite sign: however, to define a change of the sign of curvature here leads to a 
contradictory result since there is a unique such point, by hypothesis, on the curve. 

Moreover it is worth noticing that zeros of curvature of 3D curves are extremely uncommon 
points: in fact looking at the equations it is clear that k — if k b — and « 1 /k 2 = -tan 2 <f>. 
That is if, given the surface containing the curve, the ratio of the two principal curvatures 
assumes a specific value at a specific point. 

Summary 

We have shown that zeros of curvature of all planar curves and of almost all non-planar 
curves are perspective invariants. The zeros of curvature of planar curves are shown to be 
structurally stable for deformations of the curve in the plane. This property still holds for 
small deformations out of the plane but we prove that it vanishes for arbitrary perturbations 
of the curve. This lack of structural stability puts a limit on the usefulness of these invariants 
for non-planar curves. Note, however, this is stability for the curve itself: if the curve does 
have zeros they will be projective invariants. 

Zero crossings of the curvature can be used to find corresponding points for stereo 
matching. Their use is limited since there are, in general, very few of them. They can be 
best used to help register the image and to detect if an object enters the forbidden zone. 

Finally zero crossings are useful for representing image curves because of their invariance 
under both perspective projection and convolution with gaussian filters. 
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References 

(1) Marr, D., Poggio, T. 1979. "A computational theory of human stereo vision" PROC. 
ROY. SOC. LOND. B204, 301-328. 

(2) Levine, M.D., Douglas, A., O'Handley, G.M. Yagi 1973. "Computer determination of 
depth maps" Computer Graphics and Image Processing, 2, 131-150. 

(3) Mori, K-l., Masatsugu, K., Asada, H. 1973. "An iterative prediction and correlation 
method for automatic stereo comparison" Computer Graphics and Image Processing, 2, 

393-401 . 

v 

14 



YUILLE, VERRI 

(4) Hannah, M.J. 1974 "Computer matching of area in stereo images" Ph.D. thesis, Stanford 
Artificial Intelligence Laboratory, AIM-239. 

(5) Panton, D.J. 1978 "A flexible approach to digital stereo mapping" Photogrammetric 
Engineering and Remote Sensing, vol 44, No 12, dec 1499-1512. 

(6) Moravec, H.P. 1980 "Obstacle avoidance in the real world by a seeing robot rover" 
Ph.D. thesis, Stanford Artificial Intelligence Laboratory, AIM-340. 

(7) Gennery, D.S. 1980 "Modelling the environment of an exploring vehicle by means of 
stereo vision" Ph.D; thesis, Stanford Artificial Intelligence Laboratory, AIM-339. 

(8) Nisihara, K. 1983 "PRISM: A practical real-time imaging stereo matcher" in: Intelligent 
robots: 3th International Conference on Robor Vision and Sensory Controls. Society of 
Photo-Optical Instrumentation Engineers, Proceedings 449, Cambridge, MA. 

(9) Torre, V., Verri, A. "On the absolute depth estimate in stereopsis" in preparation. 

(10) Poston, T., Stewart, I.N.: "Taylor's expansions and catastrophes" Pitman Publishing 
London, 1976. 

(11) Sandini, G., Straforini, M., Torre, V., Verri, A. 1984 "3D reconstruction of silhouettes" 
Proceedings of the 4th International Conference on Robot Vision and Sensory Controls, 
London. 

(12) Laughwitz, D.: "Differential and Riemannian Geometry" Academic Press, New York 
1965. 

(13) Longuet-Higgins, H.C. 1982. "The role of the vertical dimension in stereoscopic vision." 
Perception 11. 377-379. 

(14) Krol, J.D. and van der Grind, W.A. 1982. "Rehabilitation of a classical notion of Panum's 
fusional area." Perception, 11. 615-619. 

(15) Verri, A. 1984. "Methodi Matematici per la Visione Stereografica." Ph.D. thesis, 
University of Genoa. 

(16) Yuille, A.L. and Poggio, T. 1984. "A generalized ordering constraint for stereo 
correspondence." MIT, A.I. Memo 777. 

(17) Grimson, W.E.L. 1981. "From Images to Surfaces." MIT Press, Cambridge, Mass. 

(18) Asada, H. and Brady, J.M. 1984. "The Curvature Primal Sketch." Proc. IEEE workshop 
on Computer Vision. Annapolis, Maryland, 1984. 

(19) Marimont, D.H. 1984. "A Representation for Image Curves." Proc. AAAI-84. Austin, 
Texas. 



15 



^Lj-x....^^aiU-^^. 



